The On-line Cross Entropy Method for Unsupervised Data Exploration
نویسندگان
چکیده
We investigate the use of the new Cross Entropy method as a tool for exploratory data analysis. We show how this method can be used to perform linear projections such as principal component analysis, exploratory projection pursuit and canonical correlation analysis. We further go on to show how topology preserving mappings can be created usin the cross entropy method. We also show how the cross entropy method can be used to train deep architecture nets which are one of the main current research directions for creating true artificial intelligence. Finally we show how the cross entropy method can be used to optimize parameters for latent variable models. Key–Words: Cross entropy, Linear projections, Topographic mapping.
منابع مشابه
Unsupervised On-line Learning of Decision Trees for Hierarchical Data Analysis
An adaptive on-line algorithm is proposed to estimate hierarchical data structures for non-stationary data sources. The approach is based on the principle of minimum cross entropy to derive a decision tree for data clustering and it employs a metalearning idea (learning to learn) to adapt to changes in data characteristics. Its efficiency is demonstrated by grouping non-stationary artifical dat...
متن کاملHigh-Dimensional Unsupervised Active Learning Method
In this work, a hierarchical ensemble of projected clustering algorithm for high-dimensional data is proposed. The basic concept of the algorithm is based on the active learning method (ALM) which is a fuzzy learning scheme, inspired by some behavioral features of human brain functionality. High-dimensional unsupervised active learning method (HUALM) is a clustering algorithm which blurs the da...
متن کاملComparison Between Unsupervised and Supervise Fuzzy Clustering Method in Interactive Mode to Obtain the Best Result for Extract Subtle Patterns from Seismic Facies Maps
Pattern recognition on seismic data is a useful technique for generating seismic facies maps that capture changes in the geological depositional setting. Seismic facies analysis can be performed using the supervised and unsupervised pattern recognition methods. Each of these methods has its own advantages and disadvantages. In this paper, we compared and evaluated the capability of two unsuperv...
متن کاملUnsupervised Dependency Parsing with Transferring Distribution via Parallel Guidance and Entropy Regularization
We present a novel approach for inducing unsupervised dependency parsers for languages that have no labeled training data, but have translated text in a resourcerich language. We train probabilistic parsing models for resource-poor languages by transferring cross-lingual knowledge from resource-rich language with entropy regularization. Our method can be used as a purely monolingual dependency ...
متن کاملInferring Hierarchical Clustering Structures by Deterministic Annealing
The unsupervised detection of hierarchical structures is a major topic in unsupervised learning and one of the key questions in data analysis and representation. We propose a novel algorithm for the problem of learning decision trees for data clustering and related problems. In contrast to many other methods based on successive tree growing and pruning, we propose an objective function for tree...
متن کامل